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The Gold06 Snla dataset recently released in astro-ph/0611572 consists of five distinct subsets 
defined by the group or instrument that discovered and analyzed the corresponding data. These 
subsets are: the SNLS subset (47 Snla), the HST subset (30 Snla), the HZSST subset (41 Snla), 
the SCP subset (26 Snla) and the Low Redshift (LR) subset (38 Snla). These subsets sum up 
to the 182 Snla of the Gold06 dataset. We use Monte-Carlo simulations to study the statistical 
consistency of each one of the above subsets with the full Gold06 dataset. In particular, we compare 
the best fit w(z) parameters (wo,wi) obtained by subtracting each one of the above subsets from the 
Gold06 dataset (subset truncation), with the corresponding best fit parameters (wq,Wi) obtained 
by subtracting the same number of randomly selected Snla from the same redshift range of the 
Gold06 dataset (random truncation). We find that the probability for (wq,Wi) = (wq,wi) is large 
for the Gold06 minus SCP (Gold06-SCP) truncation but is less than 5% for the Gold06-SNLS, 
Gold06-HZSST and Gold06-HST truncations. This result implies that the Gold06 dataset is not 
statistically homogeneous. By comparing the values of the best fit (wo, Wi) for each subset truncation 
we find that the tension among subsets is such that the SNLS and HST subsets are statistically 
consistent with each other and 'pull' towards ACDM (too = —l,wi — 0) while the HZSST subset 
is statistically distinct and strongly 'pulls' towards a varying w(z) crossing the line w = —1 from 
below (wo < — 1, ttfi > 0). We also isolate six Snla that are mostly responsible for this behavior of 
the HZSST subset. 

PACS numbers: 98.80.Es,98.65.Dx,98.62.Sb 



I. INTRODUCTION 

Current cosmological observations show strong evi- 
dence that we live in a spatially flat universe [l[ with low 
matter density Q that is currently undergoing acceler- 
ated cosmic expansion. The most direct indication for the 
current accelerating expansion comes from the accumu- 
lating type la supernovae (Snla) data [!, 0, [f| H, IS IS 
which provide a detailed form of the recent expansion 
history of the universe. 

This accelerating expansion has been attributed to a 
dark energy component with negative pressure which can 
induce repulsive gravity and thus cause accelerated ex- 
pansion (for recent reviews see [ToL [TTI. [T^. []~3l. [T^. [T5L [T6(| ^ 
The simplest and most obvious candidate for this dark 
energy is the cosmological constant A |l7| with equa- 
tion of state w — p/p = — 1. This model however 
raises theoretical problems related to the fine tuned value 
required for the cosmological constant. These difficul- 
ties have lead to a large variety of proposed models 
where the dark energy component evolves with time 
usually due to an evolving scalar field (quintessence) 
which may be minimally [la | or non-minimally fl9| cou- 
pled to gravity. Alternatively, more general modified 
gravity theori es I20I have also been proposed based on 
fJR) theories (HTEl 11 (for a debate on the issue see 
|lj), braneworldspa |26|. |27l , [H[, Gauss-Bonnet dark 
energy (2^], holographic dark energy [3(| etc. The main 
prediction of the dynamical models is the evolution of 
the dark energy density parameter £lx(z). Combining 
this prediction with the prior assumption for the matter 
density parameter f^om, the predicted expansion history 



H(z) is obtained as 

H{z) 2 = Hi[Q 0m (l + zf + Qx(z)} (1.1) 

The dark energy density parameter is usually expressed 
as 



where w(z) is related to H(z) by [3ll. l32l. I3I 
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If the dark energy can be described as an ideal 
fluid with conserved energy momentum tensor — 
diag(p,p,p,p) then the above parameter w(z) is identi- 
cal with the equation of state parameter of dark energy 
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Independently of its physical origin, the parameter w(z) 
is an observable derived from H(z) (with prior knowledge 
of f^om) and is usually used to compare theoretical model 
predictions with observations. 

The two most reliable and robust Snla datasets exist- 
ing at present are the Gold dataset @ (hereafter Gold06) 
and the Supernova Legacy Survey (SNLS) 0] dataset. 
The Gold dataset compiled by Riess et. al. is a set of 
182 supernova data from various sources analyzed in a 
consistent and robust manner with reduced calibration 
errors arising from systematics. It contains 119 points 
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from previously published data Q (hereafter Gold04) 
plus 16 points with 0.46 < z < 1.39 discovered recently 
by the Hubble Space Telescope (HST). It also incorpo- 
rates 47 points (0.25 < z < 1) from the first year release 
of the SNLS dataset 0] out of a total of 73 distant Snla. 
Some supernovae were excluded [i[ due to highly uncer- 
tain color measurements, high extinction Ay > 0.5 and 
a redshift cut cz < 7000/cto/s or z < 0.0233, to avoid the 
influence of a possible local "Hubble Bubble", so as to 
define a high-confidence subsample. In addition, a sin- 
gle algorithm (MLCS2k2) was applied to estimate all the 
Snla distances (including those originating from SNLS) 
thus attempting to minimize the non-uniformities of the 
dataset. 

The total of 182 Snla included in the Gold06 dataset 
can be grouped into five subsets according to the search 
teams/instruments that discovered them. These subsets 
are shown in Table I. A detailed table of all the data 
used in our analysis and their subset origin is shown in 
the Appendix. Notice that the early data of the Gold06 
dataset were obtained mainly in the 90 's and consist of 
the High z Supernova Search Team (HZSST) subset, the 
Supernova Cosmology Project (SCP) subset and the Low 
Redshift (LR) subset. 

The above observations provide the apparent mag- 
nitude m(z) of the supernovae at peak brightness af- 
ter implementing correction for galactic extinction, K- 
correction and light curve width-luminosity correction. 
The resulting apparent magnitude m(z) is related to the 
luminosity distance cIl(z) through 

m th (z) = M{M,H ) + 5log 10 {D L (z)) (1.5) 

where in a flat cosmological model 

Dl[z) = {l + z) f dz'-—^ (1.6) 

Jo H(z'',ai,...,an) 

is the Hubble free luminosity distance (HqcIl/c), 
a\, a n are theoretical model parameters and M is the 
magnitude zero point offset and depends on the absolute 
magnitude M and on the present Hubble parameter Hq 
as 

r Ff- 1 

M = M + 5logio(—9-) + 25 = 
Mpc 

= M — 5log w h + 42.38 (1.7) 

The parameter M is the absolute magnitude which is 
assumed to be constant after the above mentioned cor- 
rections have been implemented in m(z). 

The data points of the Gold06 dataset are given after 
the corrections have been implemented, in terms of the 
distance modulus 

fi obs (zi) = m obs (zi) - M (1.8) 

The theoretical model parameters are determined by 
minimizing the quantity 

X (<zi,...,a„) =2_^ 2 T 2 V 1 - 9 ) 



TABLE I: The subsets of the Gold06 dataset (see also [||). 



Subsets Total Redshift Range Years of discovery Ref. 



SNLS 


47 


0.25 < z < 0.96 


2003-2004 


[7] 


HST 


30 


0.46 < z < 1.76 


1997-2005 


f9] 


HZSST 


41 


0.28 < z < 1.20 


1995-2001 


f3] 


SCP 


26 


0.17 < z < 0.86 


1995-2000 


f4] 


LR 


38 


0.024 < z < 0.12 


1990-2000 


\5] 



where at i and a 2 i are the errors due to flux uncertain- 
ties and peculiar velocity dispersion respectively. These 
errors are assumed to be gaussian and uncorrelated. The 
theoretical distance modulus is defined as 

Hth{z%) = m th {zi) - M = Uog w (D L {z)) + ^ (1-10) 

where 

Mo = 42.38 - Uog w h (1.11) 

and Hthizi) also depends on the parameters ai,...,a n 
used in the parametrization of H(z) in equation (|1.6[) . 

The parametrization used in our analysis is the CPL 
parametrization [35l . [36| 

w(z) = wo + Wi- (1-12) 

l + z 

H 2 (z) = H 2 [n 0m (l + zf + 

+(i-n 0m )(i + «) 3 ( 1 +«»+ w i) e 3»i[i/(i+«)-i]ji.i3) 

with a prior of the matter density parameter ilom — 0.28 
(as in Ref. @), assuming flatness, according to the meth- 
ods described in detail in Ref. [33, HH . 

The previous version of the Gold sample [|[ (Gold04) 
had been shown to be in mild (2a) tension with the 
SNLS dataset [H, While the Gold04 mildly fa- 

vored an evolving dark energy equation of state param- 
eter w(z) (crossing the phantom divide line w=-l) over 
the cosmological constant (ACDM) at almost 2a level 
[H [H SH, E3, [H El, the SNLS data had shown no 
such trend and provided [38[ a best fit w(z) very close 
to w = —1 (ACDM). The trend towards phantom divide 
crossing can not be explained in the context of minimally 
coupled quintessence and could be viewed as an indica- 
tion for more exotic models [H [H, |H EHHIM HII, HI • 
This mild tension could have been attributed to system- 
atic errors due eg to the different algorithm used in the 
analysis of the two datasets. The new version of the Gold 
sample however, (Gold06) involves an improved uniform 
analysis and incorporates a large part of the SNLS sam- 
ple. Thus there could have been an anticipation that the 
mild tension with SNLS would be ameliorated or even 
disappear. As shown in Fig. 1 however, this anticipation 
has not been fulfilled (see also [53l |54|). 
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FIG. 1: Maximum likelihood fits of the CPL parametrization (fLT2j) to the SNLS (a) Gold04 (b) and Gold06 (c) datasets. The 
2cr tension between the Gold and SNLS remains with the new Gold06 dataset despite the improved filtering, calibration and 
data extension. 



The mild (almost 2a) tension between the Gold04 and 
the SNLS samples (Figs, la and lb) has not decreased by 
using the Gold06 sample (Fig. lc)! The investigation of 
the origin of this tension and the statistical uniformity of 
the Gold06 dataset consist the main focus of the present 
paper. 



II. TENSION IN THE GOLD06 DATASET 

The 182 Snla included in the Gold06 dataset origi- 
nate mainly from the search teams/instruments shown 
in Table I. The low redshift subset (LR) is a mixture of 
various early Snla by different groups and instruments 
but we consider it as a single subset because otherwise 
we would have to increase the number of subsets beyond 
a reasonable number. 

In order to investigate the statistical uniformity of the 
Gold06 dataset and also the origin of the tension with 
the SNLS, we have decomposed the Gold06 dataset into 
the subsamples of Table I and constructed new datasets 
by subtracting each one (or two) of the subsets from the 
full Gold06 dataset. We thus obtained the following six 
subset truncations: 



1. 


182go6 


— 47 snls — 


SOhst 


2. 


182go6 


~ ^7 SNLS 




3. 


182go6 


— 30hst 




4. 


182go6 


- 26scp 




5. 


182go6 


— ^HZSST 




G. 


182go6 


— ^HZSST 


- 26scp 



We did not consider the subset 182go6 — 38^ with low 
redshift truncation because the LR subset is not uniform 
and also because subtracting it can not be associated 
with a corresponding random truncation in the same low 
redshift range (the range z < 0.124 is spanned completely 
by the LR subset). We then addressed the following two 
questions: 

• How do the best fit (wq,wi) values for each of 
the six truncations compare with the corresponding 
best fit value of the full GoldOG dataset? 

• How do the best fit (wq,wi) values for each of 
the six truncations compare with the correspond- 
ing best fit value of a random truncation of the full 
Gold06 dataset made in the same redshift range as 
that of the subtracted subset? 

The answer to the first question is provided in Fig. 2 
where we show the best fit values (wq , w\ ) for each one 
of the above six truncations. Notice that the two multiple 
truncations: 182go6 — ^hzsst — 26scp (point 1) and 
182go6 ~ 47 'snls — 30hst (point 6) correspond to more 
extreme best fit values of (wq, w±). The best fit (u>o, wi) 
of the Gold06 dataset along with its la and 2a contours 
is also shown in Fig. 2 (point 0). 

The following comments can be made on the basis of 
Fig. 2: 

• The truncation 182go6 — 26scp leaves the best 
fit (ioo,wi) of the Gold06 dataset practically un- 
changed 

• No single subset truncation is able to shift the best 
fit (wo,wi) values beyond the la contours of the 
Gold06 dataset. 
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FIG. 2: The la - 2a x confidence region ellipses in the 
wo — wi plane based on parametrization (| 1 - 12 p for the Gold06 
dataset and fiom = 0.28. Superposed are the best fit param- 
eter values for each one of the truncations 1-6 of the Gold06 
dataset. 



TABLE II: The six subset truncations of Fig 3. 





Dataset 




w l 


ti'j- 
m\ 


(MC) 




182 


— 47snls — SOhst 


w\ 


— — 2.21 
= 7.53 


wV. — — 



TO I = 


1.40±0.22 
2.83±1.30 


- 3.7a 




182 — <17snls 


WQ 
W\ 


^ g2 

= 3.95 


Wq= — 

w\ = 


1.38±0.12 
2.67±0.57 


- 2.2cr 




182 - SOhst 


WQ 

wi 


= -1.60 
= 4.05 


w = ~ 

w l= 


1.36±0.10 
2.60±0.64 


- 2.4cr 




182 - 26scp 


w 
wi 


= -1.39 
= 2.75 


m [= 


1.40±0.08 
2.79±0.38 


+ 0.2(7 




182 — AIhzsst 


w 
wi 


= -1.12 
= 1.34 


»5=- 
m l= 


1.40±0.11 
2.80±0.55 


+ 2.7cr 


182 


- 4:1hzsst — 2Qscp 


w 
w% 


= -1.01 
= 0.81 


>"o=- 
»[= 


1.39±0.15 
2.75±0.73 


+ 2.6cr 



• All the subset truncations (except 182 G o 6 — 26scp) 
systematically shift the best fit (wq,wi) along the 
major axis of the x 2 ellipse. In particular for 
182 G c,6 - SOhst and 182 G06 - 47 SNLS the best 
fit is left mainly under the influence of HZSST 
and is shifted along the major axis, away from 
ACDM towards an evolving w(z) crossing the line 
w = — 1 (wq < — 1, wi > 0). On the other hand 
for 182^06 — ^Ihzsst the best fit (wo,wx) is left 
under the influence of HST and SNLS and is 
shifted towards ACDM. This implies that the sub- 
sets HST and SNLS favor ACDM while the sub- 
set HZSST favors an evolving w(z) crossing the 
phantom divide w = — 1 . This result is further am- 
plified by the behavior of the multiple truncations 
182go6 _ ^Ihzsst — 26scp (further shifted towards 
ACDM) and 182 G06 - 47 SA r L5 - 30 HS t (strongly 
shifted towards a varying w(z) crossing the phan- 
tom divide w = — 1 at a level more than 2a (see 
Fig. 2)). 

Based on the above comments we conclude that the 
answer to the first question stated above can be summa- 
rized as follows: The best fit (wo,W%) values for each of 
the four single set truncations 2-5 do not differ more than 
la from the best fit corresponding values of the Gold06 
dataset but they show distinct trends which are charac- 
teristic for each one of the truncations. 

A separate question (related to the second question 
stated above) is the question of statistical consistency be- 
tween each subset truncation and the full Gold06 dataset. 
To address this question we compare the best fit value of 
(u>o , wi ) for each subset truncation with a large number 
(500) of corresponding random truncations of the Gold06 
dataset. The random truncations involve random sub- 
tractions of the same number of Snla and in the same 
redshift range as the subset truncation. These random 
truncations can be used to obtain the la range for the 



expected values of the best fit (wq,Wi) of the randomly 
truncated Gold06 dataset. 

If the best fit values (wq, w±) of the subset truncation 
is within the 1<7 range of the best fit values (wq,^) of 
the random truncation then the considered subset trun- 
cation is a typical truncation representative of the Gold06 
dataset and statistically consistent with it. If on the 
other hand (wq , loi ) differs by 2a or more from the mean 
best fit values (wq, w[) of the random truncation then the 
considered subset truncation is not a typical truncation 
and is systematically different from the full dataset. We 
have implemented the above comparison for the six sub- 
set truncations referred above and the results are shown 
in Table II and in Fig. 3. 

The following comments can be made on the basis of 
Table II and Fig. 3: 

• The SCP is a typical, statistically consistent sub- 
set of the Gold06 dataset because its truncation 
does not significantly alter the statistical proper- 
ties of the Gold06 dataset. In particular the best 
fit (uirj, wi) value of the 182 G o6 ~ 26scp truncation 
differs only by 0.2cr from the corresponding mean 
random truncation best fit (wq, w"[) which involves 
random subtraction of the same number of Snla 
from the same redshift range as the SCP subset. 

• The other five subsets considered in Fig. 3 are not 
typical subsets of the Gold06 dataset. The best 
fit (wq, wi) values of the truncations considered in 
Fig. 3 differ by more than 2a from the mean best fit 
values (wq,w{) of the corresponding random trun- 
cations. 

• An extreme case is the truncation 182 G o6 — 
47sjvls~30hst whose best fit values are 3.7ct away 
from the corresponding mean best fit values of a 
random truncation! This implies that the combi- 
nation of the 38lr + 4:1hzsst + 26 scp which is left 
over from the truncation 182 G Q6 — ^snls — 30hst 
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FIG. 3: Comparison of the best fit parameters to the subsample truncations 1-6 with corresponding random truncations of the 
Gold06 dataset. In all truncation cases (except of the SCP truncation) the best fit parameter values are shifted (in different 
directions) by more than 2a from the mean random truncation values. The point corresponding to ACDM (wq = — l,v)i = 0) 
is also shown. 



strongly favors an evolving w(z) and is statistically 
inconsistent with the Gold06 dataset. This result is 
consistent with Fig. 2 which also shows that best fit 
(wo, w\) of the truncation 182go6 — ^ snls— 30hst 
is about 3ct away from the Gold06 best fit! 

• The SNLS and HST subsets are statistically very 
similar to each other (with a trend towards ACDM) 
even though they are both significantly different 
(more that 2a) from the corresponding random 
truncations of Gold06 (see also Fig. 2). 

• Both Figs 2 and 3 indicate that the trend to- 
wards ACDM increases for more recent (HST 
and SNLS) data while earlier data (HZSST and 
SCP) seem to favor and evolving uu(z). 

The above results can also be verified by considering 
the 'pure' Gold06 dataset which does not include the 47 
Snla of SNLS. This dataset (Gold06p) consists of 135 
Snla and is essentially a filtered version of the Gold04 
dataset with the addition of the 16 Snla with 0.46 < 
z < 1.39 discovered recently by the HST. The best fit 
parameter values for the Gold06p dataset are somewhat 
shifted in the direction of varying w(z) compared to the 
full Gold06 (compare Figs. 2 and 4) as expected since 
SNLS favors ACDM. As shown in Fig. 4 and Table III, 
the effect of each subset truncation in this case is more 
prominent due to the smaller number of points in the 
Gold06p dataset. 

For example, the 135co6p — ^hzsst — 26scp trunca- 
tion shifts the best fit parameter values of the Gold06p 




FIG. 4: The la - 2a x confidence region ellipses in the 
Wo— Wi plane based on parametrization (|1.12p for the Gold06p 
dataset and Qom ~ 0.28. Superposed are the best fit 
parameter values for each one of four truncations of the 
Gold06p dataset. The best fit parameters for the truncation 
135go6p — Hhzsst — 26scp are shifted by about 3a from cor- 
responding Gold06p best fit values in the direction of ACDM. 



by about 3a in the direction of ACDM (and beyond it) 
while the shift with respect to the random truncations of 
Gold06p is 3.7a (Fig. 5). The corresponding shifts with 
respect to the Gold06 dataset were about la and 2.6c 
respectively (Figs. 2 and 3). 
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FIG. 5: Comparison of the best fit parameters to the subsample truncations shown in Table III with corresponding random 
truncations of the Gold06p dataset. In all truncation cases (except of the SCP truncation) the best fit parameter values are 
shifted (in different directions) by more than 2<r from the mean random truncation values. The best fit parameter shift of the 
135go6p — <11hzsst — 26scp is 3.7a compared to the corresponding random truncation. The point corresponding to ACDM 
(wq — —l,it;i = 0) is also shown. 



III. DISCUSSION-CONCLUSION 

The fact that more recent Snla data (HST and SNLS) 
seem to favor ACDM significantly more than earlier data 
(HZSST) makes it possible that earlier data may be more 



TABLE III: The four subset truncations of Fig 5. 



Dataset 




t"0 
If I 


w 
w l 


(MC) 


TO — W T 
° U) r 


135 - SOhst 


TOO 
TO1 


= -2.21 
= 7.53 


w 0=~ 
w l = 


1.63±0.17 
3.98±0.97 


-3.6cr 


135 - 26,scp 


TOO 
TO1 


= -1.75 
= 4.52 


w 0=~ 
w l = 


1.63±0.17 
3.91±0.75 


-0.8(7 


135 - AIhzsst 


TOO 
TO1 


= -1.20 
= 1.90 


w 0=~ 
to[ = 


1.60±0.21 
3.76±0.95 


+ 1.9a 


- 4:1hzsst — 2Qscp 


TOO 
TO1 


= -0.42 
= -1.83 


w 0=~ 
w l = 


1.67±0.37 
3.95±1.55 


+ 3.7a 



prone to systematic errors. It is therefore interesting to 
identify a small subset of Snla from the HZSST data that 
is mostly responsible for the trend of HZSST towards an 
evolving w(z). We have isolated the group of Snla in the 
HZSST subset whose distance modulus differs by more 
than 1.8cr from the ACDM predictions (tt 0m = 0.28). 
The group which consists of just six Snla is also signif- 
icantly responsible for the trend of the HZSST subset 
towards an evolving w(z). These Snla are: (SN99Q2, 
SNOOee, SNOOec, SN99S, SNOlfo, SN99fv). The shifted 
best fit parameter values (wq,wi) due to these six Snla 
data truncation are shown in Fig. 6a superposed on a 
Monte-Carlo simulation of corresponding random 6 point 
truncations to the HZSST subset. We anticipate that the 
possible systematic errors that lead to the distinct behav- 
ior of the HZSST subset are maximal for these six Snla 
and it may be easier to identify them and correct them 
in this set of six Snla. Alternatively these 6 Snla could 
be discarded from the Gold06 dataset as outliers in an 
effort to improve its statistical uniformity and bring it to 
line with the more recent data. 
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FIG. 6: a. The best fit parameter values for the Gold06p dataset for random 6 point truncations from the HZSST subset. The 
parameter shift is maximized at 3.9a when the following six points are truncated: (SN99Q2, SNOOee, SNOOec, SN99S, SNOlfo, 
SN99fv) (red dot). These are also the points whose distance modulus differs by more than 1.8<r from the KCDM predictions, 
b. The best fit distance modulus (dashed line) relative to ACDM and the data of the Gold06 dataset in the redshift range of 
the HZSST subset. The six points of the HZSST subset which differ from KCDM by more than 1.8er are colored in red. They 
are also the most favorable points for an evolving 111(2). 



A visual display of the six datapoints (points in red) 
compared to other datapoints is shown in Fig. 6b 
where we show the distance modulus relative to ACDM 
(f2om = 0.28) of the Gold06 data in the redshift range 
of the HZSST subset. In the same plot we show (thick 
dashed line) the distance modulus corresponding to the 
best fit values (w = — 1.62,wi = 3.95) obtained from 
the Gold06p data (dashed line) indicating that all of the 
six red datapoints strongly favor the best fit w(z) over 
ACDM. 

In conclusion we have demonstrated that despite the 
careful filtering and the improved calibration, the Gold06 
dataset is plagued with statistical inhomogeneities which 
are possibly due to systematic errors. Given the fact that 
the more recent data (SNLS and HST) are statistically 
consistent with each other and homogeneous, it is highly 
probable that the possible source of systematic errors lies 



within the earlier data and in particular in the HZSST 
subset. 

Numerical Analysis: The mathemat- 

ica files and the datafile used in the numer- 
ical analysis of this work may be found at 
|http: / /leandros.physics.uoT7g r/gold06 /gold06.htm or 
may be sent by e-mail upon request. 
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IV. APPENDIX 



TABLE IV: The Gold06 datasct with its subsets. The six outliers of the HZSST subset are denoted by a 
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